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Abstract 

The Pseudo-Boolean Optimization (PBO) and Maximum Satisfiability (MaxSAT) 
problems are natural optimization extensions of Boolean Satisfiability (SAT). In 
the recent past, different algorithms have been proposed for PBO and for MaxSAT, 
despite the existence of straightforward mappings from PBO to MaxSAT and vice- 
versa. This papers proposes Weighted Boolean Optimization (WBO), a new uni- 
fied framework that aggregates and extends PBO and MaxSAT. In addition, the 
paper proposes a new unsatisfiability-based algorithm for WBO, based on recent 
unsatisfiability-based algorithms for MaxSAT. Besides standard MaxSAT, the new 
algorithm can also be used to solve weighted MaxSAT and PBO, handling pseudo- 
Boolean constraints either natively or by translation to clausal form. Experimental 
results illustrate that unsatisfiability-based algorithms for MaxSAT can be orders 
of magnitude more efficient than existing dedicated algorithms. Finally, the paper 
illustrates how other algorithms for either PBO or MaxSAT can be extended to 
WBO. 



1 Introduction 

In the area of Boolean-based decision and optimization procedures, natural extensions 
of Boolean Satisfiability (SAT) include Maximum Satisfiability (MaxSAT) [10] and 
Pseudo-Boolean Optimization (PBO) [6]. Algorithms for MaxSAT and PBO have been 
the subject of significant improvements over the last few years. This in turn, motivated 
the use of both PBO and, more recently, of MaxSAT in a number of practical appli- 
cations. Interestingly, albeit there are simple translations from any MaxSAT variant to 
PBO and vice-versa (by encoding to CNF) [1, 18], algorithms for MaxSAT and PBO 
have evolved separately, and often use fairly different algorithmic organizations. Nev- 
ertheless, there exists work that acknowledges this relationship and algorithms that can 
solve instances of MaxSAT and of PBO have already been proposed [1, 18]. 

Recent work has provided more alternatives for solving either MaxSAT or PBO, 
by using SAT solvers and the identification of unsatisfiable sub-formulas [16, 27]. 
However, the proposed algorithms were restricted to the plain and partial variants of 
MaxSAT and to a restricted form of Binate Covering for PBO. This paper extends this 
recent work in a number of directions. First, the paper proposes a simple algorithm for 
(Partial) Weighted MaxSAT, using unsatisfiable sub-formula identification. Second, 
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the paper generalizes MaxSAT and PBO by introducing Weighted Boolean Optimiza- 
tion (WBO), a new modeling framework for solving linear optimization problems over 
Boolean domains. Third, the paper shows how to extend the unsatisfiability-based al- 
gorithm for MaxSAT for solving WBO problems. Finally, the paper suggests how other 
algorithms can be used for solving WBO. Besides the proposed contributions, the paper 
also provides empirical evidence that unsatisfiability-based MaxSAT and WBO solvers 
can outperform state-of-the-art solvers on problem instances from practical problems. 

The paper is organized as follows. Section 2 provides a brief overview of the top- 
ics addressed in the paper, namely MaxSAT, PBO, translations from MaxSAT to PBO 
and vice-versa, and unsatisfiability-based algorithms for MaxSAT. Section 3 details an 
algorithm for (Partial) Weighted MaxSAT based on unsatisfiable sub-formula identifi- 
cation. Next, Section 4 introduces Weighted Boolean Optimization (WBO), and shows 
how to extend the algorithm of Section 3 to WBO. Section 5 analyzes the experimental 
results, obtained on representative classes of problem instances. Section 6 overviews 
related work, and Section 7 concludes the paper. 

2 Preliminaries 

This section briefly introduces the Maximum Satisfiability (MaxSAT) problem and its 
variants, as well as the Pseudo-Boolean Optimization (PBO) problem. The main ap- 
proaches used by state-of-the-art solvers are summarized. Moreover, translation proce- 
dures from MaxSAT to PBO and vice-versa are overviewed. Finally, unsatisfiability- 
based MaxSAT algorithms are surveyed, all of which the paper uses in later sections. 

2.1 Maximum Satisfiability 

Given a CNF formula tp, the Maximum Satisfiability (MaxSAT) problem can be de- 
fined as finding an assignment that maximizes the number of satisfied clauses (which 
implies that the assignment minimizes the number of unsatisfied clauses). Besides 
the classical MaxSAT problem, there are also three well-known variants of MaxSAT: 
weighted MaxSAT, partial MaxSAT and weighted partial MaxSAT. All these formu- 
lations have been used in a wide range of practical applications, namely scheduling, 
FPGA routing [34], design automation [31], among others. 

A partial CNF formula is described as the conjunction of two CNF formulas pu 
and (p s , where tph represents the hard clauses and tp 3 represents the soft clauses. The 
partial MaxSAT problem consists in finding an assignment to the problem variables 
such that all hard clauses (iph) are satisfied, and the number of satisfied soft clauses 
((p s ) is maximixed. 

A weighted CNF formula is a set of weighted clauses. A weighted clause is a pair 
(u>, c), where co is a classical clause and c is a natural number corresponding to the cost 
of unsatisfying lu. Given a weighted CNF formula, the weighted MaxSAT problem 
consists in finding an assignment to the problem variables such that the total weight of 
the satified clauses is maximized (which implies that the total weight of the unsatisfied 
clauses is minimized). 

A weighted partial CNF formula is the conjunction of a weighted CNF formula 
(soft clauses) and a classical CNF formula (hard clauses). The weighted partial MaxSAT 
problem consists in finding an assignment to the variables such that all hard clauses are 
satisfied and the total weight of satisfied soft clauses is maximized. Observe that, for 
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both partial MaxSAT and weighted partial MaxSAT, hard clauses can also be repre- 
sented as weighted clauses: one can consider that the weight is greater than the sum of 
the weights of the soft clauses. 

Starting with the seminal work of Borchers and Furman [10], there has been an 
increasing interest in developing efficient MaxSAT solvers. Following such work, two 
branch and bound based solvers have been developed: (i) MaxSatz [20], the first solver 
to implement a unit propagation based lower bound and a failed literal based lower 
bound, both closely linked with a set of inference rules; (This solver has been extended 
into several solvers: IncMaxSatz [22], WMaxSatz [3], WMaxSatz_icss [13].) (ii) Mini- 
MaxSAT [18], a solver created on top of MiniSAT with MaxSAT resolution [9] applied 
over an unsatisfiable sub-formula detected by the unit propagation based lower bound. 
A different approach has been the conversion of MaxSAT into a different formalism. 
The most notable works using this approach have been: Toolbar [19], a weighted CSP 
solver which converts MaxSAT instances into a weighted constraint network; SAT4J 
MAXSAT [7], a solver which iteratively converts a MaxSAT instance into a PBO in- 
stance; Clone [29] and sr(w) [30], solvers which convert a MaxSAT instance into a 
deterministic decomposable negation normal form (d-DNNF) instance; and MSUn- 
Core [27], a solver which solves MaxSAT using the unsatisfiable cores detected by 
iteratively encoding the problem instance into SAT. In the Max-SAT Evaluations [4], 
this latter approach has been shown to be effective for industrial problems. 

2.2 Pseudo-Boolean Optimization 

The Pseudo-Boolean Optimization (PBO) problem is another extension of SAT where 
constraints can be any linear inequality with integer coefficients (also known as pseudo- 
Boolean constraints) defined over the set of problem variables. The objective in PBO 
is to find an assignment to problem variables such that all problem constraints are sat- 
isfied and the value of a linear objective function is optimized. Any pseudo-Boolean 
formulation can be easily translated into a normal form [6] such that all integer coeffi- 
cients are non-negative. 



Almost all algorithms to solve PBO rely on the generalization of the most effec- 
tive techniques already used in SAT solvers, namely Boolean Constraint Propagation, 
conflict-based learning and conflict-directed backtracking [24, 11]. Nevertheless, there 
are several approaches to solve PBO formulations. The most common using SAT 
solvers is to make a linear search on the value of the objective function. The idea is 
to generalize SAT algorithms to deal natively with pseudo-Boolean constraints [6] and 
whenever a solution for the problem constraints is found, a new constraint is added such 
that only solutions with a lower value for the objective function can be accepted. The 
algorithm finishes when the solver cannot improve on the last solution found, therefore 
proving its optimality. 

Another common approach is branch and bound, where lower bounding proce- 
dures to estimate the value of the objective function are used. Several lower bounding 
procedures have been proposed, namely Maximum Independent Set of constraints [12], 
Linear Programming Relaxation [21, 23], among others [23]. There are also algorithms 
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that encode pseudo-Boolean constraints into propositional clauses [33, 5, 15] and solve 
the problem by subsequently using a SAT solver. This approach has been proved to be 
very effective for several problem sets, in particular when the clause encoding is not 
much larger than the original pseudo-Boolean formulation. 

2.3 Translations between MaxSAT and PBO 

Although MaxSAT and PBO are different formalisms, it is possible to encode any 
MaxSAT instance into a PBO instance and vice-versa [2, 1, 17]. This section focus 
solely on weighted partial MaxSAT, since the encodings of the other variants easily 
follow. 

The encoding of hard clauses from weighted partial MaxSAT to PBO is straightfor- 
ward, since propositional clauses are a particular case of pseudo-Boolean constraints. 
However, for each soft clause u>i = (li V I2 V . . . V Ik) with weight Cj, the encoding to 
PBO involves the use of an additional selection variable Sj, such that the correspond- 
ing constraint in PBO to would be + J2j=i h — 1- This ensures that variable 
Si is assigned to true whenever uji is not satisfied. The objective function of the cor- 
responding PBO instance is to minimize the weighted sum of the selection variables. 
For each selection variable Si in the objective function, its coefficient is the weight Cj 
of the corresponding soft clause uii. 

Example. Consider the following weighted partial MaxSAT instance. 

¥>h ={ (xi V x 2 V x 3 ), (x 2 V x 3 ), (xi V £3)} 
Lp s ={ (x 3 ,6),(xi Vi2,3),(ii Vx 3 ,2)} 

According to the described encoding, the corresponding PBO instance would be: 

minimize 6si + 3s 2 + 2S3 
subject to x\ + x 2 + X3 > 1 

x 2 + X3 > 1 

xi + x 3 > 1 (3) 
si + X3 > 1 

5 2 + Xl + x 2 > 1 

53 + xi + X3 > 1 

□ 

The encoding of PBO constraints into MaxSAT can be done using any of the pro- 
posed encodings from pseudo-Boolean constraints to clauses [33, 5, 15]. Hence, for 
each pseudo-Boolean constraint there will be a set of hard clauses encoding it in the 
respective MaxSAT instance. The number of clauses and additional variables, depends 
on the translation process used. The encoding is trivial when the original constraint in 
the PBO instance is already a clause. 

The objective function of PBO instances can be encoded into MaxSAT with the use 
of weighted soft clauses. The idea is that for each variable Xj with coefficient cj in 
the objective function, a corresponding soft clause (xj) with weight Cj is added to the 
MaxSAT instance. Therefore, the solution of the MaxSAT formulation minimizes the 
weighted sum of problem variables, as required in the PBO instance. 
Example. For illustration purposes, consider the following PBO instance: 

minimize Ax\ + 2x 2 + x% 

subject to 2xi + 3^2 + 5x3 > 5 

xi + x 2 > 1 ( } 

xi + x 2 + x 3 > 2 
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Note that the first and third constraint must be encoded into CNF, but the second con- 
straint is already a clause and so it can be represented directly as a hard clause. The 
corresponding MaxSAT instance would be: 

<p h ={ CNF(2xi +3x 2 + 5x 3 > 5), (xi V5 2 ),CNF(i 1 + x 2 + x 3 > 2)} 
Vs ={ (5i,4),(x 2 ,2),(x 3 ,l)} 

(5) 
□ 

2.4 Unsatisfiability-Based MaxSAT 

Recent work proposed the use of SAT solvers to solve (partial) MaxSAT, by iteratively 
identifying and relaxing unsatisfiable sub-formulas [16, 27, 26, 25]. In this paper we 
refer to these algorithms generically as MSU (Maximum Satisfiability with Unsatisfia- 
bility) algorithms. 

The original algorithm of Fu&Malik (referred to as MSU1.0) iteratively identifies 
unsatisfiable sub-formulas. For each computed unsatisfiable sub-formula, all original 
(soft) clauses are relaxed with fresh relaxation variables. Moreover, a new Equals 1 
(or AtMostl) constraint relates the relaxation variables of each iteration, i.e. exactly 
1 of these relaxation variables can be assigned value 1. The MSU1.0 algorithm can 
use more than one relaxation variables for each clause. In the original algorithm [16], 
a quadratic pairwise encoding of the Equals 1 constraint was used. Finally, observe 
that the Equals 1 constraint in line 13 of Algorithm 1 can be replaced by an AtMostl 
constraint, without affecting the correctness of the algorithm. 

More recently, several new MSU algorithms were proposed [26, 27]. The differ- 
ences of the MSU algorithms include the number of cardinality constraints used, the 
encoding of cardinality constraints (of which the AtMostl and Equals 1 constraints are 
a special case), the number of relaxation variables considered for each clause, and 
how the MSU algorithm proceeds. Extensive experimentation (from [25] but also 
from the MaxSAT Evaluation [4]) suggests that an optimized variation of Fu&Malik's 
algorithm[25] is currently the best performing MSU algorithm. 

3 Unsatisfiability-Based Weighted MaxSAT 

This section describes extensions of MSU1.X, described in Algorithm 1, for solving 
(Partial) Weighted MaxSAT problems. One simple solution is to create Cj replicas of 
clause ojj, where Cj is the weight of clause uij. The resulting extended CNF formula 
can then be solved by MSU1.X. The proof of Fu&Malik's paper would also apply 
in this case, and so correctness follows. The operation of this solution for (Partial) 
Weighted MaxSAT justifies a few observations. Consider an unsatisfiable sub-formula 
ipc where the smallest weight is min c . Each clause would be replaced by a number 
of replicas. Hence, this unsatisfiable sub-formula would be identified min c times. 
Clearly, this solution is unlikely to scale for clauses with very large weights. Hence, a 
more effective solution is needed, which is detailed below. 

An alternative solution is to split a clause only when the clause is included in an 
unsatisfiable sub-formula. The way the clause is split depends on its weight. An al- 
gorithm implementing this solution is shown in Algorithm 2. For each unsatisfiable 
sub-formula, the smallest weight min c of the clauses in the sub-formula is computed. 
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Algorithm 1 The (Partial) MaxSAT algorithm of Fu&Malik [16] 



MSUl(<p) 



1 ipw *— f > Working formula, initially set to tp 

2 while true 

3 do (st,fc) <- SAT(ipw) 

4 E> ipc is an unsatisfiable sub-formula if ipw is unsat 

5 if st = UNSAT 

6 then V fl <- 

7 for each w 6 

8 do if not hard(w) 

9 then r is a new relaxation variable 

10 lor <— w U {r} > W.R is tagged non-auxiliary 

11 <pw <— - {^} U {Ufl} 

12 F fl «- V R U {r} 

13 vpjj <— CNF(^3 rgv r = 1) [> Equalsl constraint 

14 Set all clauses in lpr as hard clauses 

15 Lpw <- V'w U t> Clauses in (ys^ are declared hard 

16 else t> Solution to MaxSAT problem 

17 v | blocking variables w/ value 1 | 

18 return \(p\ — v 



This smallest weight is then used to update a lower bound on minimum cost of unsat- 
isfiable clauses. Clauses in the unsatisfiable sub-formula are relaxed. However, if the 
weight of a clause is larger than min c , then the clause is split: a new relaxed clause with 
weight min c is created, and the weight of the original clause is decreased by min c . 
Example. Consider the partial MaxSAT instance in (2). Assume that the unsatisfiable 
sub-formula detected in line 4 of Algorithm 2 is: 

<Pc = { (x2 V x 3 ), (xi V x 3 ), (x 3 ,6),(xi Vx 2 ,3)}. (6) 

Then, the smallest weight min c is 3, and the new formula becomes ipw = fh U (p s , 
where 

<Ph ={ (xi V x 2 V x 3 ), (x 2 V x 3 ), (xi V cc 3 ),CNF(si + s 2 = 1) } , 
ip s = { (x 3 ,3),(xi VXs,2),(8l VX3,3),(S 2 Vai Vx 2 ,3)}. 

□ 

Observe that the new algorithm can be viewed as a direct optimization of the naive 
algorithm outlined earlier. The main difference is that each iteration of the algorithm 
collapses min c iterations of the naive algorithm. For clauses with large weights the 
difference can be significant. 

Theorem. [Correctness of WMSU1] The value returned by Algorithm 2 is minimum 
cost of non-satisfied clauses in (p. □ 

Proof. The previous discussion and the proof in [16]. □ 



4 Weighted Boolean Optimization 

This section introduces Weighted Boolean Optimization (WBO), a new framework for 
modeling with hard and soft pseudo-Boolean constraints, that extends both MaxSAT 
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Algorithm 2 Unsatisfiability-based (Partial) Weighted MaxSAT algorithm 



WMSUl(v?) 



1 ipw *— f > Working formula, initially set to <p 

2 cost n <— 

3 while true 

4 do (st, ipc) <- SAT(ipw) 

5 O pc is an unsatisfiable sub-formula if tpw is unsat 

6 if st = UNSAT 

7 then mm c <— oo 

8 for each w 6 i^c 

9 do if not hard(oj) and cost (to) < min c 

10 then mine *— cost(w) 

11 costib «— costib + mm c 

12 V R <- 

13 for each w 6 <^c 

14 do if not hard(tj) 

15 then r is a new relaxation variable 

16 Vr <- Vr U {r} 

17 Wii : <— U {r} > ojjj is tagged non-auxiliary 

18 cost{uiR_) <— miric 

19 if cosf(w) > min c 

20 then <— <pw U {<^b} 

21 cosi(w) <— cosJ(w) — min c 

22 else ipw <— V'w — {^} U {<^h} 

23 (^jj <— CNF(53 rg y r — 1) t> Equalsl constraint 

24 Set all clauses in ipR as hard clauses 

25 <pw *- V'w-' U Vfl t> Clauses in tfiR are declared hard 

26 else E> Solution to Weighted MaxSAT problem 

27 return costw 



and its variants and PBO. Furthermore, a new algorithm based on identifying unsatis- 
fiable sub-formulas is also proposed for solving WBO. 

An Weighted Boolean Optimization (WBO) formula ip is composed of two sets 
of pseudo-Boolean constraints, (p s and tp^, where <p a contains the soft constraints and 
(fih contains the hard constraints. For each soft constraint g <p a there is an associ- 
ated integer weight Cj > 0. The WBO problem consists in finding an assignment to 
the problem variables such that all hard constraints are satisfied and the total weight 
of the unsatisfied soft constraints is minimized (i.e. the total weight of satisfied soft 
constraints is maximized). 

It should be noted that WBO represents a generalization of weighted partial MaxSAT 
by introducing the use of pseudo-Boolean constraints instead of just using proposi- 
tional clauses. Hence, more compact formulations can be obtained with WBO than 
with MaxSAT. Moreover, PBO formulations can also be linearly encoded into WBO. 
Constraints in PBO can be directly encoded as hard constraints in WBO and the ob- 
jective function can also be encoded as described in section 2.3. Therefore, WBO is 
a generalization of MaxSAT and its variants, as well as of PBO, allowing a unified 
modeling framework to integrate both of these Boolean optimization problems. 
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4.1 Unsatisfiability-Based WBO 

This section describes how Algorithm 2 (introduced in Section 3) for weighted partial 
MaxSAT can be modified for solving WBO formulas. First of all, in a WBO formula, 
constraints are not restricted to be propositional clauses. Both soft and hard constraints 
can be pseudo-Boolean constraints. Hence, ip is a pseudo-Boolean formula, instead of 
a CNF formula. Moreover, the use of a SAT solver in line 6 is replaced with a pseudo- 
Boolean solver extended with the ability to generate an unsatisfiable sub-formula from 
the original pseudo-Boolean formula. 

Next, if the formula is unsatisfiable, the weight associated with the unsatisfiable 
sub-formula is computed in the same way (lines 9-13) and the soft constraints in the 
core must also be relaxed using new relaxation variables (lines 15-24). Consider that 
u) = a jlj > b denotes the pseudo-Boolean constraint to be relaxed using variable r. 
The resulting relaxed constraint in line 19 will be u)r = b ■ r + a jh — b- 

Finally, the constraint on the new relaxation variables in line 25 does not need to 
be encoded into CNF. The pseudo-Boolean constraint Ylrtv r = 1 can be directly 
added to tpw, resulting in a more compact formulation, in particular if the number of 
soft constraints in the core is large. 

In some cases, for an unsatisfiable sub-formula with k soft constraints, it is pos- 
sible to use less than k additional variables. Consider the following soft constraints 
uj\ = Y^I el-l a tjh — bi and uj-2 = X^eL 2 a ijh — ^2 in a given unsatisfiable sub- 
formula, where L\ and L2 denote respectively the set of literals in constraints u>i and 
u>2. Additionally, let Xk G L\, Xk G L2, aik > bi and a,2k > b%, i.e. assigning Xk to 
true satisfies lo\ and assigning Xk to false satisfies ll>2- 1 In this case, these constraints 
can share the same relaxing variable. This is due to the fact that it is impossible for 
both u>i and lo^ to be unsatisfied by the same assignment, since either Xk satisfies w\ or 
Xk satisfies u>2- Therefore, by using the same relaxing variable on both constraints, it 
is maintained the restriction that at most one soft constraint in the core can be relaxed. 
Example. Suppose that the following set of soft constraints defines an unsatisfiable 
sub-formula in a WBO instance: 

u 1 = 2xi + 3x2 + 5^3 > 5 

L02 = xi+x 2 >l (S) 

LJ 3 = X 2 +X 3 > 1 

OJ4 = X\ + x 3 > 1 

In this case, constraints u>\ and 0J3 can share the same relaxation variable, since the 
assignment of a value to X3 implies that either lo\ or 0J3 is satisfied. The same occurs 
with ll>2 and 014, given that the assignment to x\ either satisfies L02 or 0J4. Therefore, 
after the relaxation, the resulting formula can include just two relaxation variables, 
instead of four. The resulting formula would be: 

5si + 2x\ + 3x2 + 5^3 > 5 

S 2 + X\ + X2 > 1 

81 + X2 +X 3 > 1 (9) 

s 2 + X\ +x 3 > 1 
Si + s 2 < 1 

□ 



'This is a generalization to pseudo-Boolean constraints. Note that if the WBO instance corresponds to a 
MaxSAT instance, this is very common to occur, since u>i and u>2 are clauses. 
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Table 1 : Classes of problem instances 



Class 


#1 


MaxSAT Variant 


Source 


IND 


110 


Partial Weighted 


To Appear in MaxSAT Evaluation 2009 


FIR 


59 


Partial 


Pseudo-Boolean Evaluation 2007 


SYN 


74 


Partial 


Pseudo-Boolean Evaluation 2005 



The application of this reduction rule of relaxing variables raises the problem of 
finding the smallest number of relaxation variables to be used. This problem can be 
mapped into finding a matching of maximum cardinality in an undirected graph. In 
such a graph, there is a vertex for each constraint in the unsatisfiable sub-formula, while 
edges connect vertexes corresponding to constraints that can share a relaxation variable. 
The problem of finding a matching of maximum cardinality in an undirected graph can 
be solved in polynomial time [14]. Nevertheless, our prototype implementation of 
WBO solver uses a greedy algorithmic approach. 

4.2 Other Algorithms for WBO 

An alternative solution for solving WBO is to extend existing PBO algorithms. For 
example, soft pseudo-Boolean constraints can be represented in a PBO instance as re- 
laxable constraints, and the overall cost function becomes the weighted sum of the 
relaxation variables of all soft pseudo-Boolean constraints of the original WBO for- 
mulation. This solution resembles the existing approach for solving MaxSAT with 
PBO [2, 1], and has the same potential drawbacks. 

One additional alternative solution is to generalize branch and bound weighted par- 
tial MaxSAT solvers to deal with soft and hard pseudo-Boolean constraints. However, 
note that these approaches focus on a search process that uses successive refinements 
on the upper bound of the WBO solution, while the algorithm proposed in section 4. 1 
works by refining lower bounds on the optimum solution value. 

5 Results 

With the objective of evaluating the new (partial) weighted MaxSAT algorithm and the 
new WBO solver, a set of industrially-motivated problem instances was selected. The 
characteristics of the classes of instances considered are shown in Table 1 . For each 
class of instances, the table provides the class name, the number of instances (#1), the 
type of MaxSAT variant, and the source for the class of instances. 

Moreover, a wide range of MaxSAT and PBO solvers were considered, all among 
the best performing in either the MaxSAT or the Pseudo-Boolean evaluations. The 
weighted MaxSAT solvers considered were WMaxSatz [3], MiniMaxSat [18], IncW- 
MaxSatz [22], Clone [29], and SAT4J (MaxSAT) [7]. In addition, a new version of 
MSUnCore [26, 27, 25], integrating the weighted MaxSAT algorithm proposed in Sec- 
tion 3, was also evaluated. The PBO solvers considered were BSOLO [23], PBS [1], 
Pueblo [32], Minisat+[15], and SAT4J (PB) [7]. Finally, results for the new WBO 
solver, implementing the WBO organization described in Section 4 is also shown. 

All experiments were run on a cluster of Linux AMD Opteron 2GHz servers with 
1GB of RAM. The CPU time limit was set to 1800 seconds, and the RAM limit was 
set to 1 GB. 
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Table 2: Solved Instances for MaxSAT Solvers 



Class 


WMaxSatz 


MiniMaxSat 


IncWMaxSatz 


Clone 


SAT4J (MS) 


MSUncore 


IND 


11 





110 





10 


110 


FIR 


7 


14 


33 


5 


10 


45 


SYN 


22 


29 


19 


13 


21 


34 


Total (Out of 243) 


40 


43 


162 


18 


41 


189 



Table 3: Solved Instances for PBO & WBO Solvers 



Class 


BSOLO 


PBS 


Pueblo 


Minisat+ 


SAT4J (PB) 


WBO 


IND 


17 











60 


110 


FIR 


20 


11 


14 


22 


7 


39 


SYN 


51 


19 


30 


30 


22 


33 


Total (Out of 243) 


88 


30 


44 


52 


89 


172 



All algorithms were run on all problem instances considered. The original repre- 
sentations were used, in order to avoid introducing any bias towards any of the prob- 
lem representations. Tables 2 and 3 summarize the number of instances aborted by 
each solver for each class of instances. As can be concluded, for practical problem in- 
stances, only a small number of MaxSAT solvers is effective. The results are somewhat 
different for the PBO solvers, where several can be competitive for different classes of 
instances. It should be noted that the IND benchmarks can be considered challenging 
for pseudo-Boolean solvers due to the large clause weights used. 

For class IND and for the MaxSAT solvers, the results are somewhat surprising. 
Some of the solvers perform extremely well, whereas the others cannot solve most of 
the problem instances. IncWMaxSatz, MSUnCore and WBO are capable of solving all 
problem instances, but other MaxSAT solvers abort the vast majority of the problem 
instances. One additional observation is the very good performance of IncWMaxSatz 
when compared to WMaxSatz. This clearly indicates that the lower bound computation 
used in IncWMaxSatz can be very effective, even for industrial problem instances. For 
the PBO solvers, given the set of benchmark instances considered, SAT4J (PB) and 
BSOLO come out as the best performing. Clearly, this conclusion is based on the 
class of instances considered, which nevertheless derive from practical applications. 
Moreover, SAT4J (PB) performs significantly better than SAT4J (MaxSAT). This may 
be the result of a less effective encoding internally to SAT4J. 

Motivated by the overall results, the best MaxSAT, PBO and the WBO solver were 
analyzed in more detail. Given the experimental results, IncWMaxSatz, MSUnCore, 
and WBO were selected. Figure 5 shows the results for the selected solvers by increas- 
ing run times. 

As can be concluded, the plot confirms the trends in the tables of results. MSUn- 
Core is the best performing, followed by WBO and IncWMaxSatz. For smaller run 
times (instances from class IND), IncWMaxSatz can be more efficient than WBO. 
Moreover, these results indicate that, for the classes of instances considered, encoding 
cardinality constraints into CNF (as done in MSUnCore) may be a better solution than 
natively handling cardinality and pseudo-Boolean constraints (as done in WBO). It 
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Figure 1: Run times for IncWMaxSatz, MSUnCore, and WBO for all instances 



should be noted that all the instances considered can be encoded with cardinality con- 
straints, for which existing polynomial encodings guarantee arc-consistency. This is 
not true for problem instances that use other pseudo-Boolean constraints, and for which 
encodings that ensure arc-consistency are exponential in the worst-case [15]. Finally, 
another source of difference in the experimental results is that whereas MSUnCore is 
built on top of PicoSAT [8], WBO is built on top of Minisat2. The different underlying 
SAT solvers may also contribute to explain some of the differences observed. 



6 Related Work 

A brief account of MaxSAT and PBO solvers is provided in Section 2. The use of un- 
satisfiability for solving MaxSAT was first proposed in 2006 [16]. This work was later 
extended [26, 27, 25], to accommodate several alternative algorithms and a number of 
optimizations to the first algorithm. To the best of our knowledge, MSUnCore is the 
first algorithm for solving (Partial) Weighted MaxSAT with unsatisfiable sub-formula 
identification. Also, to the best of our knowledge, WBO represents a new modeling 
framework, and the associate algorithm is new. 

The use of optimization variants of decision procedures has also been proposed 
in the area of SMT [28], and a few SMT solvers now offer the ability for solving 
optimization problems. The approaches used for solving optimization problems in 
SMT are based on the use of relaxation variables, similarly to the PBO approach for 
solving MaxSAT [1]. 
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7 Conclusions and Future Work 



This paper proposes a new algorithm for (Partial) Weighted MaxSAT, based on unsat- 
isfiable sub-formula identification. In addition, the paper introduces Weighted Boolean 
Optimization (WBO), that aggregates and generalizes PBO and MaxSAT. The paper 
then shows how unsatisfiability-based algorithms for (Partial) Weighted MaxSAT can 
be extended to WBO. Finally, the paper illustrates how to extend other algorithms for 
PBO and MaxSAT to solve WBO. 

Experimental results, obtained on a representative set of benchmark instances shows 
that the new algorithm for weighted MaxSAT can outperform other existing algorithms 
by orders of magnitude. The experimental results also provide a preliminary (al- 
beit possibly biased) study on the performance differences between handling pseudo- 
Boolean constraints natively and encoding to CNF. Finally, the paper shows that a 
general algorithm for WBO can be as efficient as other dedicated algorithms. 

The integration of MaxSAT and PBO into a unique optimization extension of SAT 
increases the range of problems that can be solved. It also allows developing other 
general purpose algorithms, integrating the best techniques from both domains. Future 
research work will address adapting other algorithms for WBO. One concrete example 
is the use of PBO solvers. The other is extending the existing family of MSU algorithms 
for WBO. 

Acknowledgement. This work is partially supported by EU grant ICT/2 17069 and 
FCT grant PTDC/EIA/76572/2006. 
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